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Abstract 

Szemeredi's regularity lemma is a fundamental tool in extremal graph theory, theoreti¬ 
cal computer science and combinatorial number theory. Lovasz and Szegedy 1191 gave 
a Hilbert space interpretation of the lemma and an interpretation in terms of compact¬ 
ness of the space of graph limits. In this paper we prove several compactness results 
in a Banach space setting, generalising results of Lovasz and Szegedy fT9l as well as a 
result of Borgs, Chayes, Cohn and Zhao |5|. 


1 Introduction 

1.1 The regularity lemma 

Szemeredi's regularity lemma |[27l is a fundamental tool in extremal graph theory, theoret¬ 
ical computer science and combinatorial number theory. See liTSU for a survey. The lemma 
has many interpretations, variations and extensions. See for example [iZl [El HI HSl HU HU 

ll|2iH9ll2i|5l- 

Very roughly the lemma says something of the form: for each e > 0 there exists /: G N 
such that the vertex set of any graph can be partitioned into at most k parts, such that 
for 'almost' all pairs of parts the edges between that pair of parts behaves 'almost' like 
a random bipartite graph, where 'almost' depends on e. The weak regularity lemma of 
Frieze and Kannan lT2l weakens the requirements of the partition in the regularity lemma 
and measures the error of approximation with respect to the cut norm. This has as a 
consequence that the constant k can be taken to be much smaller. From the perspective 
of the adjacency matrix of a graph this means that one approximates this matrix with a 
bounded sum of cut matrices (in particular this gives a low rank approximation) such that 
their difference is small with respect to the cut norm. This is exactly the point of view we 
take in this paper: we want to find various types of low rank approximations to matrices 
and tensors, when measured in a particular norm. 

Our work is inspired by the work of Lovasz and Szegedy 111911 and Borgs, Chayes, Cohn 
and Zhao [S] relating the compactness of the space of graph limits to Szemeredi's regularity 
lemma. We refer to the book by Lovasz 1211 for more details on graph limits. In 1201 Lovasz 
and Szegedy used the weak version of the regularity lemma Ifl2l to assign a limit object 
to a convergent sequence of dense graphs. This limit object is no longer a graph, but a 
symmetric measurable function W : [0,1]^ —>• [0,1], called a graphon. In llT9l Lovasz and 
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Szegedy showed that the space of graphons, equipped with the cut metric is compact, 
interpreting this result as an analytical form of the regularity lemma. Their compactness 
result implies various kinds of regularity lemmas varying from weak to very strong. It 
has recently been extended by Borgs, Chayes, Cohn and Zhao |5l to the space of R-valued 
functions W with bounded p-norm, the U-graphon space (for any fixed p > 1). 

1.2 Compactness 

We will now describe the compactness of the graphon space, which is denoted by W, more 
precisely (for details concerning definitions we refer to the next section), after which we 
mention some of the results in the present paper. 

Let W : [0,1]^ —?■ R be an integrable function. Consider for p,q G [l,oo], W as 
a kernel operator W : LP([0,1]) —> L‘?([0,1]); that is, for / G LP([0,1]), (W/)(x) := 
/[o 1 ] The p i-G (^-operator norm is defined by 

W\v^q = sup ||W/||,, 
ll/lb = l 

where || • ||s denotes the s-norm on the space L®([0,1]). The norm || • ||ooi-^i is equivalent to 
the cut norm. Define an equivalence relation ~ on W as follows: W ~ W' if for each e > 0 
there exists a measure preserving bijection t : [0,1] —> [0,1] such that j]W — rW'jjoo^i < e 
for W, W' G W. Then the result of Lovasz and Szegedy IT^ can be stated as follows: 

the space (W, Jj ■ l|oon.i)/ ~ is compact. (1) 

The result of Borgs, Chayes, Cohn and Zhao [51 then says that we can replace W with the 
symmetric functions in LP([0,1]^) of norm at most 1 for any fixed p > 1. 

In this paper we will show that in ([l]) we can also replace the norm ]] • jjoon-i by the norm 
II ■ Wq^JL^, if we replace W by the unit ball of LP( [0,1]^), provided that p cf. Theorem 

14.11 In fact, we generalise (H), replacing the space W by a special weakly compact subset 
of a Banach space X, the relation ~ by an equivalence relation obtained from a subgroup 
of fhe group of autmorphisms of X and the norm || • ||ooi-^i by an operator-type norm, cf. 
Theorem 13.21 From this result it is then easy to derive the results of Borgs, Chayes, Cohn 
and Zhao. In Section |4] we will also utilise it to include q i-G ^^-norms and apply it to 
higher order tensors. In Section |5] we will apply it to ^P-spaces. 

Our method is based on work of fhe author and Schrijver [24l . In [241 the compactness 
result of Lovasz and Szegedy was extended to a general Hilbert space setting, putting em¬ 
phasis on the possibility of using different norms than the cut norm and the use of groups 
and moreover using a different method of proof. Consequently, our proof of Theorem 13.21 
does not use the martingale convergence theorem. Thus it yields a different proof of the 
compactness result of Borgs, Chayes, Cohn and Zhao [5]. However, there are some simi¬ 
larities. To prove Theorem 13.21 we need a result from 11241 . cf. Lemma l3.5l which may be 
viewed as a weak regularity lemma in a Hilbert space setting, and which generalises weak 
regularity results from [1211111 . 

1.3 Algorithms and applications 

Some of the existing versions of the weak and strong regularity lemmas come with efficient 
algorithms for finding a low rank approximation (or regularity partition). These algorithms 
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have been applied to find approximation schemes for various sorts of dense instances of 
counting and optimisation problems UTZlITTl and to property and parameter testing [HIBIZI; 
see also the book by Lovasz ETII . 

Some of our results can also be put to algorithmic use. In particular, in the £P setting. 
Lemma 15.31 can be used to give approximation algorithms for certain instances of comput¬ 
ing the matrix p q norm and for finding approximate Nash-equilibria in two player 
games, in a similar spirit as has been done by Barman in |j3l. In the LP setting sampling 
algorithms from Borgs, Chayes, Lovasz, S6s and Vesztergombi [7] can be applied to find 
low rank approximations to matrices yielding polynomial time approximation algorithms 
for compufing the matrix p q norm for dense mafrices. This is work in progress and we 
will report on it in a forthcoming paper Il23ll . 

1.4 Organisation 

In the next section we will discuss some preliminaries and set up some notation. In Section 
|3]we will state and prove Theorem I3.2[ the aforementioned generalisation of (HJ. We will 
also deduce some consequences from it. In Section |4] we will apply this theorem to LP 
spaces and in Section |5] to £P spaces. 

2 Preliminaries and notation 

In this section we will give some preliminaries on Lebesgue spaces and set up some nota¬ 
tion. We refer to IS] for functional analytic background and to lUSlI for measure theoretic 
background. 

Lebesgue spaces For a measure space {Cl,A,p) and p G [l,oo] we denote by LP(Q) the 
linear space of equivalence classes of f/-integrable complex (or real) valued functions / : 
Q —>• C (or R) with bounded p-norm, which is defined as 

ll/llp ■= (/ p < 00 , and 

||/||oo := inf{|/(x)| < t I for p-almost all x}. 

(Recall that two functions are equivalent if they are equal p-almost everywhere.) 

For our results it often does not matter whether we use real or complex-valued func¬ 
tions. So we generally do not distinguish between the complex and real-valued cases. If 
however we want to specify that we work over the field of real numbers, we denote this 
by Lg(n). We often omit the reference to the sigma-algebra A and the measure p. In case 
Q = [0,1]^ for some I G N we will always equip it with the Borel (or Lebesgue) sigma 
algebra and with the Lebsegue measure A. 

For a set Q, and p G [1, oo], (Q) is just equal to LP (Cl) with A the power set of O and 
p the counting measure. We often write LP and £P whenever the underlying space is clear. 

For a normed space (Y, || • ||) we denote its closed unit ball by B(Y, || • ||), which is 
defined as {p G Y | ||p|| < 1}. Often we just write B{Y). Let {Cl,p) be a probability space, 
i.e., p(n) = 1. An important property of the space LP(n), that we will often use, is the 
nesting of the closed unit balls: for any 1 < p < q < oo we have 

B(L“) C B{L^) C B{LP) C B(L^). (2) 
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For the closed unit balls in 1^(0), for any set O, the opposite inclusions hold: 


B{f ) c B{ep) c B{e^) c B{r). 


( 3 ) 


Weak topologies We often need weak topologies in this paper. So it wil be convenient 
to introduce some notation. Let (X, || • ||) be a normed space. Let X* be the dual space 
of X, i.e., the space of all continuous linear functions / : X —> C (or K). Let Y C X* 
be a subset of X*. The weak topology induced by Y on X is generated by sets of the form 
^xo,f,e = ^ I l/(^) “ /(^o)| < £} for xq E X, f E Y and e > 0. If we do not specify Y 

we mean the weak topology induced by X*. 

For p E [1, oo] let 

^ if 1 < p < oo. 


V 


* 


1 if p = oo, 
00 if p = 1. 


It is well known that LP* isometrically embeds into (LP)* and this embedding is onto if 
p < 00 (which holds for p = 1 provided that p is sigma finite). So if Q is a probability 
space, we can consider the weak topology on B(LP) induced by Lt for each p > p* (by @). 
We denote this by (B(LP),a;^). For £P we need to take q < p*. This is then denoted by 
(B(£P),Wg). 


Group actions If a group G acts on a set S this induces an action on the functions from S to 
C (or R) via gf{s) := f{g^^s) for g E G, a function / and s E S. Moreover, G has a natural 
action on for any Z G N. In particular, if (Q, A, p) is a measure space and a group G acts 
on n such that p{gA) = p{A) for all measurable sets A E A and y G G (in which case we 
call elements of G measure preserving bijections), then G acts on X = LP(n^) for any p and I 
and preserves the p-norm. If a group acts on a set S and T C S we denote by GT the set 
{gt I y G G, f G T}. We call T Q S G-stable if GT = T. 


3 Compact orbit spaces in Banach spaces 

In this section we will state and prove our main results concerning compact orbit spaces in 
Banach spaces and discuss some consequences, which may be viewed as regularity lemmas 
in a Banach space setting. 


3.1 The main theorems 


Before we can state our results, we need some definitions. Let X = (X, || • ||) be a normed 
space and let X be a bounded subset of X*. We define a seminorm || • ||r and pseudo metric 
dji on X by 

||v||r := sup|r(v)| dR{x,y) := \\x - y\\R (4) 

reR 


for x,y E X. 

For a pseudo metric space (X, d) let Aut(X) denote the group of invertible maps g : 
X —>• X that preserve d. Let G be a subgroup of Aut(X). Define a pseudo metric d/G on X 
by 

{d/G){x,y) ■= inf d(x,gy) 

geG 


4 



for x,y G X. Note that since [d/G){x,y) is just equal to the distance between the G-orbits of 
X and y, this implies that d/G is indeed a pseudo metric. For our purposes it is sometimes 
more convenient to work with {X,dlG) than with Xf G, but note that {X,d/ G) is compact 
if and only if X/G is compact. Recall that a (pseudo) metric space is called totally bounded 
if for each e > 0 it can be covered with finitely many balls of radius e. 

We can now state our first result about compactness of orbit spaces in Banach spaces, 
which we will prove in Section IT2l 

Theorem 3.1. Let (X, || ■ ||) foe fl Banach space and let Gbe a subgroup o/Aut(X). Let R C B{X*) 
be G-stable, and let W C X be G-stable and weakly compact. If {]N,d^/G) is totally bounded, then 
{W,dR/G) is compact. 

Showing that {W,dR/G) is totally bounded may not be very simple. However, if W is 
somehow 'close' to a Hilbert space (as will be made precise below) and R can be embedded 
into a bounded subset of this Hilbert space, then totally boundedness of (W,dK/G) can be 
deduced from compactness of the space of sums of elements from R modulo G. 

For a subset Y of a linear space X and fc G N we define 


^ {yi^ ■■■ + yk\yi^ 


Note that when Y is convex, fo • Y is just equal to kY. Let X be a normed space and let H be 
a Hilbert space. We call W C X H-smalJ^ if here exists a contractive linear map T : H ^ X 
and a function c : (0,oo) —)■ N such that W C c{e)T{B{H)) + eB(X) for each e > 0. Note 
that T gives rise to a contractive linear map T* : X* —^H*, the adjoint of T, defined by 
/ I— 7- (fo I— t f{T{h))) for f E X* and fo G H. Identifying H with H* (which we will always 
do) this gives a contractive linear map TT* : X* —)■ X. When we talk about a H-small space 
we will implicitly assume the presence of the maps T, T* and c. 

Theorem 3.2. Let (X, || ■ ||) foe fl Banach space and let Gbe a subgroup o/Aut(X). Let R C B{X*) 
be G-stable and let W C X be G-stable and weakly compact. If there exists a Hilbert space H such 
that W is H-small and if {k ■ {TT*{R)),dR/G) is compact for each fo G N, then {W,dR/G) is 
compact. 

Observe that when X is a Hilbert space. Theorem 13.21 reduces to MMl Theorem 2.1]. 
Before we give a proof of Theorem 13.21 let us remark that the compactness of the LP- 
graphon space proved by Borgs, Chayes, Cohn and Zhao |5] follows almost immediately 
from it. Let R C L“([0,1]^) be defined by 

K •= {XaxB I a, B C [0,1] measurable}. 

This makes || • ||r into the cut norm. Let us denote the group of measure preserving bijec- 
tions T : [0,1] —)■ [0,1] by Sp,!]. Then ds/S^o,!] is equal to fon, the cut metric. The result of 
Borgs, Chayes, Cohn and Zhao is then equivalent to the following: 

Corollary 3.3. Let p > 1. Then (B(LP([0,l]^)),dR/S[ 04 ]) compact. 

^The notion of H-smallness can be seen as a qualitative refinement of relative weak compactness, by a 
classical result of Grothendieck mi. Moreover, related notions have been used elsewhere in functional analysis, 

cf. nni. 
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Proof. In case p > 2 we take X = L^, otherwise we set X = L^. Write W = B{LP) C X and 
let H = L^. Then H is a Hilbert space and W is H-small by |5], or see Lemma 144] (the map T 
being the identity.) Note also that T*T restricted to R is the identity Since any measurable 
set A can be mapped onto any interval of length A(A) by a measure preserving bijection, 
cf. [22], it follows that (R*^,cIr/Sjo^]) is compact and hence {k ■ R,dR/S[o 4 ]) well, as it 
is a continuous image of {R’^,dR/ (see EH). Let us first assume that p < oo. Then, 
as (B(LP),Wp*) is compact by the Banach-Alaoglu theorem, it follows that (B(LP),Woo) is 
compact. (Since Wco induces a weaker topology than Wp*.) In case p = oo, we may use 
that B(L“) C B{U), for any fixed s > 1, is a closed convex set with respect to the s-norm. 
This implies that {B{L^),Ws*) is compact and hence (B(L°°),Woo) is compact, as desired. 
Theorem 13.21 now implies that {B[U’),dR/ G) is compact. □ 

With little additional effort we can derive something similar as Corollary C.8 in [51 : 

Corollary 3.4. Given a function k : (0, oo) —)■ (0, oo), let 

W, := n K{e)B{L^{[0,lf)) + eB{Li{[0,l]^)). 

£>0 

Then (W^, ds/Sp^]) is compact. 

Proof. Throughout the proof we assume that we work over the real numbers. Let again 
H = tf and X = L^. Then W^ C X is clearly H-small by (O. So by Theorem 13.21 it suffices 
to check that (Wk,Woo) is compact. We may assume that Wk is contained in B(L^). Since 
(B(L“)*,zeoo) is compact by the Banach-Alaoglu theorem and contains B(L^), it suffices to 
show that Wk is weakly closed. 

To this end let p be an element of the weak closure of Wk. Then p is a finitely additive 
signed measure on [0,1]^. We will show that p is in fact sigma additive. To see this, let 
6 > 0 and choose d = e?c(e)^^. Then for each measurable set U C [0,1]^ there exists 
w E Wjc such that \p{LI) — J^wdAj < e. This implies that if A(H) < d, then p(LI) < 3e, 
as for each w G Wk, | J^jWdA\ < A{U)K{e) + e = 2e. Let now {Un)neiN be a collection of 
pairwise disjoint measurable sets. Write U = Then, by sigma additivity of the 

Lebesgue measure, we have A(U„>]vH„) —> 0, as N tends to infinity. This implies that 
t 0, as N tends to infinity. So p{U) = 'E.net^ showing that p is sigma 

additive. 

Since p is finite, the Radon-Nikodym theorem implies the existence of an integrable 
function / such that f^fdA = p{U) for each measurable H. 

We will now show that / is again contained in Wk. Let e > 0 and define U := {x \ 
f{x) > k{£)}, V := {x \ f{x) < —k(£)} and let d > 0. Then there exists w E such that 
I /^(/ — w)dA\ < d and | fy(f — w)dA\ < d. This implies 

[ \f\dA= [ fdA- [ fdA< [ wdA- [ wdA + 2d 
Juuv Ju Jv Ju Jv 

<[ \w\dA + 2d < A{UUV)K{£)+e + 2d. (5) 

Juuv 

Since ((Sj) holds for any ^ > 0, this shows that f E Wk and finishes the proof. □ 

Remark 1. The requirement that we work over the real numbers in the corollary above can 
be omitted if we choose to define Wk in the following way: 

Wk:- nW(£)(S(bR([0,lF))+^B(L^([0,l]2)))+£(B(Lj,([0,l]2))+iB(L3,([0,lp))). 
£>0 
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3.2 Proofs of Theorem 13.11 and 13.21 

The proofs of Theorems 13.11 and 13.21 follow the same pattern as the proof of Theorem 2.1 in 
[H]. Let us start with the proof of Theorem 13.11 

Proof of Theorem l3T] Since (W,dR/G) is totally bounded it suffices to show that (W, ds/G) 
is complete. Let ai,a 2 ,... be a Cauchy sequence in {W,dji/G). We may assume that 
(dR/G)(fl;,< 2^' for each i. Next find iteratively g E G such that < 2^' 

and replace by Then d^^ai, af < 2^'+^ for all i and j > i and hence this sequence 

is Cauchy with respect to d^. We will show that this sequence is also convergent. 

Let for n G N, denote the weak closure of the set {an,a„^i, ...}. By weak compact¬ 
ness, A := n„g]NA„ is not empty. Let a E A. We will show that converges to a with 
respect to d^. Let e > 0. Choose N such that for all n,m > N, dR{an,am) < e. We will show 
that dR{a„,a) < 2£ for all n > N. To this end fix r ^ R. Then there exists m > N such that 
I (r. Urn — < £■ Then for any n > N we have 

\{r,a- a„)\ < \r,a- am)\ + \{r,am - a„)\ < 2e, 

showing that d^{an,ci) < 2£. Hence («„) converges to a with respect to d^. □ 

To prove Theorem I3.2[ we need the following lemma from fMH . which may be viewed 
as a weak regularity lemma in a Hilbert space setting. In particular, choosing appropriate 
R, we recover results from |[T2l and I1TT]| respectively. 

Lemma 3.5 ( 1241 ). Let H be any Hilbert space. Let R C B(H) be closed under multiplication by 
elements o/{z G C | |z| < 1} (by elements of [—1,1] if H is real). Then for any /: G N, 

B{H)Ck-R + ^B{H,\\-\\R). 

Vk 

For convenience of the reader we will give a proof. 

Proof. Let us denote the inner product on H by (•,•)■ Let a G B{H). Write aq = If 
for some i > 0, then there exists r E R such that |(fl;,r)| > Set flj+i = 
fl; — (fl;, r)r. Note that by induction we have that — ao E i ■ R C k ■ R, as \ (a,, r)\ < 1 by 
Cauchy-Schwarz. Then 

Il«!+i|l2 = ll^illl + \{ai,r)\^Ml = ||a,||| - |(A,,r)|^(2 - ||r|||) < ||a,||| - 1/k, 

by definition of r and the fact that R C B(H). By induction we have that ||a;+i ||2 < 1 — i/k. 
This shows that for some i < k we must have ||a;||r < and hence finishes the proof. □ 

We can now prove Theorem l3.2[ 

Proof of Theorem l372l By Theorem 13. II it suffices to show that {W,dR/ G) is totally bounded. 
We may assume that R is closed under multiplication by elements of{z G C | |z| < 1} 
(elements of [—1,1] if our spaces are real), as this does not changes the norm induced by 
R. Neither does it change the compactness of {k ■ {TT*{R)),dR/ G) for any k. To show that 
{W,dR/G) is totally bounded, choose £ > 0. By assumption there exists a Hilbert space H 
such that W is H-small. This means there exists a contractive linear map T : H ^ X and a 
constant c > 0 such that W C cT{B{H)) + £B{X). As {k- {TT*(R)),d^/G) is compact there 
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exists a finite set F C k ■ {TT*{R)) such that k ■ {TT*{R)) C GF + jB(X, || ■ ||r). Setting 
k := we have by Lemma |3^ since F{B{Fl, || • ||t»(r))) C B(X, || • ||r), 

WCcT(B(H))+eB(X) Cc(ic-(Tr(R))+ic-i/2T(B(H),||- ||^,(R)))+eB(X) C 
c(GF + ^B(X, II • Hr) + k-^'HiX, II • Hr)) + 6B(X) C GcF + 3eB(X, H • |U)- 

This shows that {W,dR/G) is totally bounded and finishes the proof. □ 

Remark 2. The proof shows that if R is already closed under multiplication by elements of 
{z G C I |z| < 1}, then it is enough to demand that {k ■ TT*{R),d^/G) is merely totally 
bounded. 

3.3 Weak and strong regularity 

The following is implicit in the proof of Theorem 13.21 and may be viewed as an extension 
of the weak regularity lemma from the Hilbert space setting to a Banach space setting. 

Lemma 3.6. Let {X, 11-11)^^^? Banach space, letWcX and let R C B(X*). Suppose there exist a 
Hilbert space H such that W is H-small. Then for each e > 0 there exists k < \c{e)/e]^ such that 
for each w EtN there exists a G {z G C | |z| < 1}^ and xi,...,xi G TT*{R), with I < k, such 
that H^i’ — cjji^iOCiXi\\R < 2e. 

In |[T9]| , Lovasz and Szegedy applied the compactness of the graphon space, cf. ([T]), 
to derive an approximation result for graphons, cf. IfT^ Lemma 5.2]. This result implies 
several types of regularity lemmas varying from the weak regularity lemma 11121 , to the 
original lemma ETl . to a 'super strong' variant [Tj. See II2T1 for more details. We can derive 
something similar in our Banach space setting: 

Lemma 3.7. Let (X, H • H) be a Banach space, let G C Aut(X), let R C B(X*) and let W C X 
be G-stable and suppose that {'W,dR/G) is compact. Let for k E ^Sl, Yk CW be G-stable such that 
Y := is dense in W (w.r.t. H • |p- B : (0, oo) x N —> (0,1) be any function. Then for 

any e > 0 there exists N G N such that for any w E W there exists w' E W and y E Ym, with 
m < N, such that 

—'^'Wr < h{£,m) and \\w' — y\\<£. 

The proof goes along the same lines as the proof of Lemma 5.2 in IIT^ . 

Proof. We may assume that h is monotonically decreasing in its second variable. Let e > 0. 
Since Y is dense in W, for each w E W, there exists « G IN and y E Yn such that Hw — yH < £. 
Let f{w) denote the smallest n such that there exists y E Yn with H^i^ — yll < £■ For za G W 
let 0{w) denote the dR/G-open set defined as 

0{w) := {w' E W I {dR/G){w,w') < h{e,f{w))}. 

By compactness of {W,dR/G), it follows that there exists Wi,. ..,Wt such that the union 
of the 0{wi) contains W. This means that for any w E W there exists i E {1,... ,t} and 
y G Ym, with m =/(a;,), such that Hw, —yH < e and {dR/G){w,Wi) < h{e,f{wi)). Choosing 
N := maxi^i^ jf{wi) and a suitable g E G applied to both Wj and y we arrive at the desired 
conclusion. □ 
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Since the norm || ■ || on X satisfies ||x|| < ||x||r for each x G X, taking h{£,m) = e for all 
m, Lemma 13.71 implies several types of weak regularity lemmas by taking different choices 
of Yjt- In particular, it allows to use different types of approximations not based on sums of 
elements from {z G C I |z| < l}rT*(R) as in Lemma [YH We will elaborate a bit more on 
this in the next two sections, where we will apply the results obtained here to the spaces 
^P(N') and LP([0,1]'). 


4 Compact orbit spaces in L®(([0,1]^) 

In this section we will apply Theorems 13.11 and 13.21 to the Banach space X = L®([0,1]^) for 
some fixed s G [1, oo) and I G N. Let for any q G [l,oo], 

:= {n ® ® r, I r,- G B(L'?([0,1]))} C B(L‘?([0,1]')). 


Recall that S[o,i] denotes the group of measure preserving bijections t : [0,1] —)■ [0,1]. We 
will derive the following result from Theorems 13.11 and 13.21 generalising Corollary 13.31 the 
compactness result of Borgs, Chayes, Cohn and Zhao |51. 

Theorem 4.1. Let p G (1, oo] and let q be such that q > p*. Fix I G N. Then the space 
(B(LP([O,l]0), dj^i)/S[ 04 ] is compact. 

We will prove Theorem 14.11 in Section 14.11 below. Let us first make some remarks and 
state some consequences. 

Borg, Chayes, Cohn and Zhao 13, who proved Theorem l4.1l for I = 2 and q = oo, already 
noted that the same result cannot be true when p = 1. We note here that in case p = 2 we 
really need that q > 2 since B(L^([0,1]^), <ij^ 2 )/S[ 04 ] totally bounded. To see this take 

fi to be the function which is constant i on the rectangle [0, 1/i] x [0, 1/i]. Since for rank 2 
functions / we have 1[/1 |r 2 < jj/jji < 2j]/j]j^2, we may as well replace by d 2 . Then for 
any tt G S[o 4 ] we have for i = 2^ < j = 2^ with I >k + 2, 



> i_2P+i-' > 1/2, 


implying that we need to take q > 2 when p = 2. This example of course generalises to any 
I > 2 and p,q such that q = p*. 

Janson HT^ showed, using the Riesz-Thorin theorem, that in case p = co (and I = 2), 
Theorem 14.11 remains true if one replaces the j] ■ norm by the po <10 operator norm 
for any po,qo > 1- See IfTbl Lemma E.6]. We can also use the Riesz-Thorin theorem in our 
setting for 1 = 2. (We need to work over the complex numbers though. This does not cause 
any problems for real-valued functions, as the complex and real operator norms are within 
a constant factor of each other.) Let us take p > 1 and q > p*. Taking / G B(LP([0, 1]^)), we 
then have l|/l|p*n.p < 1. Define for d G (0, 1) pe and qe by 


1 

Pe 


1-0 0 

— * —' 
p* Cj 


and 


1 

^0 


1-0 0 

- 1 — 

p Cj* 


( 6 ) 


Then by the Riesz-Thorin theorem (cf. gl Theorem 1.1.1]) = 1|/1|®,- By 

Theorem l4.ll this implies the following: 
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Corollary 4.2. Let p,q ^ such that q > p*. Let 9 G (0,1) and let pg and qg be defined as in 

(IDl. Then (B(LP([0,1]^)), || • Wpe^qg)/S[o^i] is compact. 

By Lemma |3^ the following is a direct corollary to Theorem 14.11 and the previous corol¬ 
lary. 

Corollary 4.3. Let p,q ^ such that q > p*. Fix I G N. Let for /: G N, Fjt C B(LP([0,1]^)) 
be S^Qiystable such that F := U^^f^Fp is a dense subset o/B(LP([0,1]^)) (zv.r.t. (|| • Let 

: (0, oo) X N —7- (0,1) be any function. Then for any e > 0 there exists N G N such that for any 

g G B(LP([0,1]^)) there exists g' G B(LP([0,1]^)) and f G Fm, with m < N, such that 

\\g - g' WrJ <Hsrm) and \\g’- f\\q* < e. ( 7 ) 

In case I = 2 and pg and qg are defined by (HI), the R‘1 norm may be replaced by II • llpsi-^iye ©■ 

There are various choices for the sets Fp in the corollary above. For example one can 
take Fp to be those function that are sums of at most k rectangles (a rectangle is a function 
of the form cxaix---xA, with A, measurable and c a constant.) A special case is to take Fp 
to be those sums of rectangles that are coming from a partition of [0,1] into at most k sets. 
Another choice would be to take Fp to be those functions that take only k different values 
(i.e. step functions with k steps). 


4.1 Proof of Theorem 14.11 

To prove Theorem 14. li we need some preliminary results. 

The next lemma implies that B(LP([0,1]^)) C L^([0,1]*) is H-small for H = L^([0,1]^) 
and any p G (1,2]. 

Lemma 4.4. Let {Cl,p) be any probability space. Let p > p' > 1 and e > 0. Then there exists a 
constant C such that B{Lf’(Cl)) C CB(L“(Q)) + eB^Lf'(Cl)). 

Proof. Define for convenience B® := B(L®(Q)), for any s G [1, ooj- Fix any K > 1 and let 
/ G BP. Let A := {m G O I |/(a;)| > K}. Then f = fi+ f2 with /i = fxa\A and /2 = fxA- 
Clearly, fi G fCB“. Next we consider ||/2||p': 

m\t= [ l/2l'’'<if<< / \f2\’’\\f\/Kr-rd,,<K’’’-’’ [ 

" Jo. Jo Jo 

Hence choosing C in such a way that C^^p/p' = e we obtain the desired result. □ 


Lemma 4.5. Let p > s > 1 and let e > 0. Then for any fc G N there exists a constant C such that 
R[cCRr + £R[. 

Proof. The proof is by induction on k. The case k = 1 follows by Lemma |4Al Now suppose 
k > 1. Choose any p' G (s, p) and let ci > 0. By induction, there exists a constant Ci such 
that Q CiRfLi + ^^k-i -|- dR^ . Let us define for s, t G [1, oo]. 


Then 


K\i ■■= {/i®/2l/ieRLn/2eR(}. 

RP c C?(Rr + Ci^(R,% + Rtti) + (8) 
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pf 

Next choose t] > 0. Then by induction there is a constant C 2 such that C C 2 R“ + //Rj 
and R^ ^ C C 2 Rf_i + Plugging this into (|8l) we obtain that 

Rl c CRT + CinHR'^Xi + srij) + 

where C := + 2^CiC2. Finally, using that Rj C R® for any f > s and I G N, and first 

choosing S such that < l/3e and then tj such that CiSrj < l/3e, we obtain the desired 
inclusion. □ 

Proof of Theorem l4d] Let us write R® instead of R® for any s G [l,oo]. Let us denote S[o,i] 
by G. Define X = L‘?*([0,1]^). Then W = B(LP([0,1]^)) C X, as p > q*. The proof now 
proceeds in a number of steps. 

Let 

^ •= {XAi X ■ ■ • X XAi I C [0,1] measurable for each i}. 

Note that |1 • ||r and || • ||r~ define equivalent norms on L^([0,1]^). More precisely, for 
/ G L^([0,1]^), we have 

ll/IU<ll/IU. <4 '||/||k, 

since for the norm || • ||roo we may restrict to functions r = ri G) ■ ■ ■ G) r/ in ([4]) such that the ri 
only take values —i,i, —1 and 1. This implies that (B(L“),dRoo/G) is compact by Corollary 
13.31 or more precisely by the proof of Corollary 13.31 as the proof did not depend on I being 
equal to 2. 

We will next show: 

(B (L“), dR? / G) is compact. (9) 

To do so, let (/„) be a sequence in B(L“). By compactness of (B(L“),dR~/G) it has a 
convergent subsequence (which we may assume to be (/„) itself) that converges to some 
/ G B (L“) with respect to dR» / G. So it suffices to show that {f„ ) converges to / with respect 
to d-pt] / G. Let £ > 0. Let G be the constant from Lemma |43I such that R'? C eR^ + GR“. Fix 
N G N such that (dRoo/G)(/„ — /) < e/G for all n > N. In other words, for each n > N 
there exists gn ^ G such that \\g„ f„ - /||r~ < e/C. Then, writing /' = g„f„, 

ll/n-/llw = supr(/^-/) < sup ri{f'^- f)+r 2 {fn- f) 
reRI riSCR” 

rzeeR^ 

^ C|l/n “ /IIr“ + ^Wfn ~ /IIri < £ + 2e = 3e, 

showing that /„ converges to / with respect to /G. This proves We will now show: 

(B(LP),dRij/G) is totally bounded in X. (10) 

To this end let £ > 0 and let K be the constant from Lemma l44l such that B(LP) C RB(L“) + 
eB{L‘^*) and note that B{U*) = B(X) C B(X, || • ||r<j). Write e' = e/K. By compactness of 
(B(L“),dRi/G), there exists a finite set F C B(L°°) such that B(L“) C GF + £'B(L“, || ■ ||r<)). 
Then 

B(LP) C RGF + R£'B(L“,|| • ||R0 + eB(X,|| • ||r0 C RGF + 2£B(X,|| • ||r,), 
proving cnii. 

By the Banach-Alaoglu theorem we know that (B(LP), zvp*) is compact (here we assume 
that p < 00 , as this case is already covered). This implies that [B{LV),Wcfj is compact, since 
Wq yields a weaker topology than Wp*, as q > p*. This finishes the proof by Theorem 13.II □ 
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5 Compact orbit spaces in ^^(N^)) 

In this section we will apply Theorem 13.II to the Banach space X = for q G (l,oo]- 

Let S]N be the group of invertible maps r : N —)■ N. We denote the metric induced by |1 ■ \\p 
by dp for any p G [1, oo]. We will derive the following result: 

Theorem 5.1. Let p G [l,oo) and let q > p- Fix I G N. Then the space B(^P(N^)),d^)/S]N is 
compact. 

We will prove this result in Section lSTl below. Let us first note that we really need p < q. 
Lemma 15.31 below is not true for p = q and is a direct corollary of Theorem 15.11 It seems 
that one can only take q = p when both of them are equal to 2, but then one has to use a 
different (weaker) metric and the orthogonal group instead of Sjvj, cf. Il24l . 

By Lemma |3^ the following is a direct corollary to Theorem 15.11 

Corollary 5.2. Let p G [1, oo) and let q > p- Fix I G N. Let for k G N, Xj. C B(.^P(N^)) be 
St^i-stable such that X := UkeK^k is a dense subset o/B(^P(N^)) (w.r.t. || • \\q). Then for any e > 0 
there exists N G N such that for any y G B(£P(N^)) there exists x G X^, with m < N, such that 
\\y-x\\ci < £■ 

We can take {k ■ R) n B(^p(N 0) with R = {ri ® ■ ■ ■ (^ r; | r, G B(£P(N))} in 

the corollary above. Then the corollary says that for each e > 0 there is N such that 
each y G B(f"?(N^)) can be approximated in the ij-norm by a tensor of rank at most N. 
Unfortunately, Corollary l5.2l does not give any explicit bounds on N. It is not to be expected 
that the bounds on N will be much better than the bound given by Lemma 15.31 below (at 
least for q = oo). Indeed, for q = oo, Alon, Lee, Schraibman and Vempala |2| showed that 
for any n x n Hadamard matrix M and e G (0,1) one has that for any matrix M', such that 
IIM — M'lloo < e, the rank of M' is at least (1 — e^)n. Since all entries of a Hadamard matrix 
are 1 or —1, we need to take p = n(logn), to make sure that ||M||p is bounded. The bound 
given by Lemma l53l on N is then of order which is polynomial in n. 


5.1 Proof of Theorem 15.11 

For any q G [1, oo], a subset K C S and v G H(S) we define G H(S) by 


Xk ■- 


x[i) if i G K, 
0 otherwise. 


We need the following lemma for the proof of Theorem 15.II 

Lemma 5.3. Let S be any set. Let p G [1, oo) and let q > p. For any e > 0 there exists 
k = k{p,q,e) G N such that for any x G B{£P[S)) there exists a set K <Z S of size at most k such 
that ||xx — x\\q < e. In case q = oo we can take k = e^P. 

Proof. Let C C S be a countable set of points, which we identify with IN, such that xf) = 0 
for i ^ C. We may assume that x satisfies |x(l)| > |x(2)| > .... Since \\x\\p < 1, it follows 
that |x(i)|P < 1/z for all i. Let K = {1, ... ,k} for some k G N to be fixed later. Then for 
q < 00, 

\\XK-x\\l = Y,\x{i)\^ <Y,{l/i)‘t/P. ( 11 ) 

iiiK i>k 
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It is a well known fact that the series i (1/0^ converges for every s > 1. This implies that 
for k large enough, (ITT]| will be bounded by e'^, which finishes the first part of the proof. 

In case q = co, we have 

\\xk - x||oo = sup \x{i)\ < . 

i>k 

So taking k such that (l/k)^^P < e, we are done. □ 

Note that Lemma 1531 is not true if one replaces q by p. One can simply take x{i) = 
for i = 1,..., nP and x{i) = 0 for i > nP. Then for any constant k not depending on n and 
any set K C N of size k we have ||xx — ^||p < {nP — k)n^P = 1 — kn^P = 1 — o(l). 

Despite the fact that Lemma 15.31 is really simple, it can be utilised for algorithmic pur¬ 
poses, since we can go over all bounded size subsets of {1,... ,n} in time polynomial in n. 
This is used in |[23l to give approximation algorithms for computing matrix p q norms. 
Now we can give a proof of Theorem 15.11 

Proof of Theorem Idll Write W = B{iP{N^)). We may assume that q < co since doo/St~i yields 
a coarser topology than di^i/Sjsi for any q' < co. Let now R = Then d^ = dq. 

If p > 1, then by the Banach-Alaoglu Theorem (W,Wp*) is compact, which implies that 
{W,zVq*) is compact since Wq* induces a weaker topology than Wp*, as co > q > p and 
hence 1 < q* < p*. If p = 1, we use the fact that B(£^(N^)) is a closed and convex subset 
of and hence is weakly compact by the previous argument. So by Theorem 13.II 

it suffices to show that (W, dg)/S]N is totally bounded. To this end choose e > 0. Let 
k = k{p,q,e/2) be the constant supplied by Lemma 1531 Denote by [n] the set of positive 
integers {1,..., n} for any n G N. Let f be a finite set of points in B{£‘^{[k^f)) such that for 
each y G B{i‘l{[k^f)) there exists x E F with ||x — y\\q < tl2. By Lemma l53l for each w G W 
there exists a set fC C of size at most k such that ||w]( ~ ^\\q < £/2. Then there exists 
(7 G S]N such that cr{K) C [k^]f as the Z-tuples in K can contain at most k^ distinct numbers. 
This implies that dq{Sf^F, W) < e and finishes the proof. □ 
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